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PROBLEM TO BE SOLVED: To enable an operator to 
secure makes a desired indication even if the operator is 
unfamiliar or visually handicapped by outputting a 
corresponding voice message by 1 st operation of an 
operation button by the operator and informing an operation 
object of a choice of the operation button by 2nd operation. 

SOLUTION: With a main switch ON, an initial screen is 
displayed on a liquid crystal touch panel 91 B. Then a CPU 
101 performs other processes including a key input process 
for receiving information on operation contents, control over 
a voice guidance, a communication with other CPUs 102, 
etc., in order. According to the contents of the operation, a 
vocal operation guidance is given. Namely, a function is 
explained by lightly pressing the operation button and the 
setting process corresponding to the operation button is 
performed by pressing the button deeply. In this case, 
single-time depression (tapping) may replaces the light 
depression and quick double depression (double tapping) 
may replace the deep depression. 
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* NOTICES * 

JPO and NCIPl are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the origmal 
precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The voice output means for actuation guidance are man machine interface equipment which 
performs control according to the contents of actuation based on actuation by the operator of the manual 
operation button displayed on the display screen, and according to voice. The 1st control means which 
outputs the voice-told message corresponding to the manual operation button concemed using said voice 
output means based on the 1st actuation to said manual operation button by the operator, Man machine 
interface equipment characterized by having the 2nd control means which notifies that the manual 
operation button concemed was chosen to the candidate for actuation based on the 2nd actuation to said 
manual operation button by the operator. 

[Claim 2] It has the coordinate input device of a pressure-sensitive format as a location input means 
corresponding to said display screen. Said 1st control means When the location corresponding to said 
manual operation button in the actuation side of said coordinate input device is pushed as said 1st 
actuation, said voice-told message is outputted. Said 2nd control means Man machine interface 
equipment according to claim 1 which notifies that the manual operation button concemed was chosen 
when said location was pushed so that thrust or a count may differ from said 1st actuation as said 2nd 
actuation. 

[Claim 3] A screen-display means to display the actuation screen containing a manual operation button, 
and the location input means for specifying said manual operation button. The voice output means for 
actuation guidance are man machine interface equipment equipped with tiie control means which 
outputs the control signal according to the contents of actuation to the candidate for actuation, and 
according to voice. The voice guidance control means which directs the output of the 1st voice-told 
message in response to the 1st actuation to said manual operation button, and directs the output of the 
2nd voice-told message in response to the 2nd actuation to said manual operation button to said voice 
output means, Man machine interface equipment characterized by preparation *♦♦***. 
[Claim 4] It has the coordinate input device of a pressure-sensitive format as said location input means. 
Said voice guidance control means When the location corresponding to said manual operation button in 
the actuation side of said coordinate input device is pushed as said 1st actuation, the output of said 1st 
voice-told message is directed. Man machine interface equipment according to claim 3 which directs the 
output of said 2nd voice-told message when said location is pushed so that thmst or a count may differ 
from said 1st actuation as said 2nd actuation. 

[Claim 5] A screen-display means to display an actuation screen, and the location input means for 
specifying the location m said actuation screen. The voice output means for actuation guidance are man 
machine interface equipment equipped with the control means which outputs the control signal 
according to the contents of actuation to the candidate for actuation, and according to voice, A display- 
control means to direct the change of an actuation screen to said screen-display means in response to 
specific actuation, and when the change of an actuation screen is performed Man machine interface 
equipment characterized by having the voice guidance control means which directs the output of the 
voice-told message to the newly displayed actuation screen to said voice output means. 



http://www4. ipdl. ncipi, go. jp/cgi-bin/tran_web_cgi_ej je?u=http%3A%2F%2F. . . 1/22/2005 



Page 1 of 7 



* NOTICES ♦ 

JPC and NCIPI are net raspcnsible for any 
daioages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the origmal 
precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the man machine interface equipment for actuation of 

various devices. 

[0002] 

[Description of the Prior Art] In recent years, the technique of preparing the manual operation button of 
imagination by the screen display is adopted in various kinds of fields. An operator can direct a request 
by specifying the location corresponding to the manual operation button in a screen. 
[0003] For example, in the field of a personal computer, GUI (Graphical User Interface) serves as an 
indispensable function. When the icon which shows the various files as alternative is displayed, an 
operator operates the pointing device represented by the mouse and puts a pointer (mouse cursor) on a 
desired icon. If a click or a double click is performed in the condition, predetermined processing to a file 
will be performed. In this case, an icon has the role of a manual operation button. 
[0004] Moreover, in the device which the public, such as abundant OA equipment, and home 
electronics, ATM (automatic cash payment machine), a ticket machine of a function, use in comparison, 
the touch panel is used as an actuation input means. A touch panel is attached after the display of CRT- 
LCD etc. An operator directs a request by touching the screen so that the displayed manual operation 
button may be pushed. 

[0005] Thus, if a screen-display device is used for actuation, since actuation of the dialogic operation 
which switches a screen according to the contents of actuation is realizable, actuation of a complicated 
setup of operation can be easy-ized. Moreover, while a panel layout becomes simple and an operator 
comes to sense handiness compared with the conventional hardware type control panel which arranges 
many key switches (a mechanical cable type or electronic formula), the miniaturization of the control 
panel itself is also possible. Furthermore, especially, in an above-mentioned touch panel format, since 
the actuation input location and the display position of a manual operation button are in agreement, an 
operator can direct a request intuitively. 
[0006] 

[Problem(s) to be Solved by the Invention] However, in the former, only by the name given to a manual 
operation button as an operator is unfamiliar to actuation, the function of the manual operation button 
was not found, but there was a problem that it will be bewildered by actuation. Although it is possible as 
management of this problem to display a symbol description sentence for every manual operation 
button, if it does so, an actuation screen not only becomes complicated, but it will become a big burden 
for an operator to read an explanatory note. 

[0007] On the other hand, in the field of a computer, there is the technique of preparing the exclusive 
field for explanation in a screen. However, there was a case where an unfamiliar operator did not notice 
explanation displayed. In the control panel of a touch panel format, since unlike the tab control 
specification by the pointer in actuation of a computer a manual operation button was not specified until 
the operator could touch the screen (xmtil definite actuation was performed), the technique of preparing 
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the field for explanation was not applied. Furthermore, in the former, it was difficult for a visually 
handicapped person to operate it, and even if, even if an operator was not a visually handicapped person, 
when the abnormalities to whiich a display confuses or disappears by a certain cause arose, there was 
also a problem that actuation was impossible. 

[0008] This invention makes actuation of various devices easier, and even if an operator is unfamiliar or 
it is visually handicapped, it aims at enabling it to ensure desired directions. Other purposes are to make 
it actuation become possible, also when abnormalities arise in a display. 
[0009] 

[Means for Solving the Problem] In this invention, it is made to perform actuation guidance with voice 
according to the contents of actuation. As actuation guidance, there is a carbon button layout of the 
approximate account of the function of a manual operation button, the actuation which should be 
performed to a degree, and the newly displayed actuation screen etc. For example, when using a 
pressure-sensitive type touch panel, if a manual operation button is pressed down lightly, a functional 
description will be performed, and if it presses down strongly, the setting processing corresponding to 
the manual operation button will be made to be performed. Instead of making it push only once instead 
of pushing lightly (tapping: equivalent to the click in mouse actuation), and pushing strongly, it pushes 
twice continuously quickly (double tapping: equivalent to the double click in mouse actuation), and even 
if like, it is good. 

[0010] If voice guidance is performed, while actuation will become easy, it can be operated even if a 
display system breaks down, and it is not necessary to spoil the operating ratio of the equipment for 
actuation. The voice output means for actuation guidance the equipment of invention of claim 1 is man 
machine interface equipment which performs control accordmg to the contents of actuation based on 
actuation by the operator of the manual operation button displayed on the display screen, and according 
to voice. The 1st control means which outputs the voice-told message corresponding to the manual 
operation button concerned using said voice output means based on the 1st actuation to said manual 
operation button by the operator. Based on the 2nd actuation to said manual operation button by the 
operator, it has the 2nd control means which notifies that the manual operation button concemed was 
chosen to the candidate for actuation. 

[001 1] In the equipment of invention of claim 2, it has the coordinate input device of a pressure- 
sensitive format as a location input means corresponding to said display screen. Said 1st control means 
When the location corresponding to said manual operation button in the actuation side of said coordinate 
mput device is pushed as said 1st actuation, said voice-told message is outputted. Said 2nd control 
means When said location is pushed so that thrust or a count may differ from said 1st actuation as said 
2nd actuation, it notifies that the manual operation button concemed was chosen. 
[0012] A screen-display means to display the actuation screen where the equipment of invention of 
claim 3 contains a manual operation button. The voice output means for actuation guidance are man 
machine interface equipment equipped with the location input means for specifying said manual 
operation button, and the control means which outputs the control signal according to the contents of 
actuation to the candidate for actuation, and according to voice. It has the voice guidance control means 
which directs the output of the 1st voice-told message in response to the 1st actuation to said manual 
operation button, and directs the output of the 2nd voice-told message in response to the 2nd actuation to 
said manual operation button to said voice output means. 

[0013] In the equipment of invention of claim 4, it has the coordmate input device of a pressure- 
sensitive format as said location input means. Said voice guidance control means When the location 
corresponding to said manual operation button in the actuation side of said coordinate input device is 
pushed as said 1st actuation, the output of said 1st voice-told message is directed. When said location is 
pushed so that thrust or a count may differ from said 1st actuation as said 2nd actuation, the output of 
said 2nd voice-told message is directed. 

[0014] A screen-display means by which the equipment of invention of claim 5 displays an actuation 
screen, and the location input means for specifying the location in said actuation screen, The voice 
output means for actuation guidance are man machme interface equipment equipped with the control 
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means which outputs the control signal according to the contents of actuation to the candidate for 
actuation, and according to voice, It has the voice guidance control means which directs a display- 
control means to direct the change of an actuation screen to said screen-display means in response to 
specific actuation, and the ou^ut of the voice-told message to the actuation screen newly displayed 
when the change of an actuation screen was performed to said voice output means. 
[0015] 

[Embodiment of the Invention] Drawing 1 is the block diagram of the copying machine 1 concerning 
this invention. The copying machine 1 consists of the actuation system 10 which is man machine 
interface equipment which applied this invention, an image reader unit 20 which changes a manuscript 
into image data, a printer unit 30 which prints a copy image on a form according to an 
electrophotography process, and CPU501 which bears timing adjustment of control. The actuation 
system 10 is equipped with a control panel 90 and two CPUslOl ,102. The image reader unit 20 is the 
image read feature of the Rhine scan type, and is controlled by CPU30L The printer unit 30 is equipped 
with two or more form receipt devices, and printing using alternatively two or more sorts of forms with 
which sizes differ is constituted possible. CPU401 bears control of the printer unit 30. 
[0016] The contents of the input (directions actuation) by the control panel 90 are notified to CPUlOl 
through CPU102. CPUlOl outputs the control data DIO in which the contents of actuation are shown to 
CPU501, and tells the status-display demand from CPU501 to CPU102. Moreover, CPUlOl controls 
voice guidance peculiar to this invention. 

[0017] CPU501 gives a predetermmed action command to CPU301 and CPU401 in response to the 
input of control data DIO according to the contents. For example, when a paper size is specified, feeding 
of the form of the specified size is required of CPU401. Moreover, if imaging preparation is required 
from CPU401 and the notice of a preparation completion from CPU401 is received when initiation of a 
copy is directed, initiation of scanning will be required from CPU301. 

[0018] The top view in which drawing 2 shows the configuration of a control panel 90, and drawing 3 
are drawings showing an example of transition of a screen display. In a control panel 90 The panel reset 
key 94 for initializing the clear key 93 for initializing the ten key 92 for numerical inputs, such as the 
liquid crystal touch panel 91 for actuation of dialogic operation, copy nimiber of sheets, and a scale 
factor, and a numerical input state, and all the contents of assignment, and the termination of copy 
actuation The voice mode key 98 for the screen guidance key 97 for performing screen guidance with 
the start key 96 for directing the stop key 95 for directing and initiation of copy actuation and voice and 
an on-ofiF setup of voice guidance is arranged. The liquid crystal touch panel 91 consists of a liquid 
crystal panel (LCD module) and a pressure-sensitive-type touch panel, and is used as an actuation input 
means of mode setting including status displays (display of troubles, such as a jam serviceman call, 
etc.), and form selection. If an operator touches an induction side when the actuation screen which 
contains two or more manual operation buttons with a LCD module is displayed, the signal which shows 
the touch location and thrust will be outputted to CPU102 from a touch panel (if it touches). In this 
operation gestalt, when thrust is small (i.e., when an operator touches an induction side lightly), the 
fimction of the manual operation button corresponding to a touch location is explained with voice. When 
thrust is large, input decision processing to a manual operation button is performed like the case where 
key switches (hardkey of a mechanical cable type or an electronic formula), such as a ten key 92, are 
pushed. 

[0019] The initial screen first displayed when the main switch of a copying machine 1 is turned on 
consists of form carbon buttons K20 for specifying the status-display area El and E2 and manual form 
selection mode like drawing 3 (A). In the example of drawing 3 (A), since it means that the automatic 
form selection mode which is a default mode is set up, the inverse video (for an alphabetic character, a 
background is black at white) of the status-display area E2 is carried out. Completion of the warm up of 
an imaging system displays the message sentence of a purport and the set point of copy number of 
sheets which can be copied on the status-display area El . 

[0020] In an mitial screen Ql, if an operator pushes the form carbon button K20 strongly, it will replace 
with an initial screen Ql, and the form selection screen Q2 will be displayed. Like drawing 3 (B) in the 
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fonn selection screen Q2, the auto fonn carbon button K24 and the mimetic diagram Zl of the form 
receipt device of a three-step configxjration are arranged on left-hand side, and the paper-size carbon 
buttons K21, K22, and K23 corresponding to each of three paper sizes (A4Y, AST, A4T) selectable on 
right-hand side are arranged. "Y" of a size notation expresses "every [ corresponding to tiie main 
scanning direction of read in the longitudinal direction of a form ] width", and "T" expresses "every 
[ corresponding to the direction of vertical scanning in the longitudinal direction of a form ] length." 
Therefore, "A4Y" is A4 size of every width. An operator specifies a desired paper size by pushing 
strongly either of the paper-size carbon buttons K21 , K22, and K23. In addition, in the example of 
drawing 3 (B), in order to show that form automatic selection mode is set up as the present setup, the 
inverse video of the auto form carbon button K24 is carried out. 

[0021] Drawing 4 is the block diagram showing the whole actuation system 10 configuration, the 
component (a control panel 90, CPUlOl, CPU102) which mentioned the actuation system 10 above - in 
addition As ROM103 which memorizes a control program, RAMI 04 used as the work area of program 
execution, the image ROM 105 which memorizes the image data concerning a screen display, and bit 
map area It has the voice output section 1 10 for multi-pre KUREKUSA 107 for switching the address 
input to ** VRAM106 and VRAM106, the LCD controller 108 which controls LCD module 91 A, and 
voice guidance. The voice output section 1 10 consists of electronic speech circuit 1 lOA and loudspeaker 
1 lOB. The voice guidance control section 120 and the display and control section 130 are formed in 
CPUlOl as a component on a software function. 

[0022] ON of each key switch in a control panel 90 is detected by the key matrix 1 14. CPU102 performs 
on-off control of the LED group 1 15 according to the display directions from CPUlOl while it codes the 
contents of actuation which the key matrix 1 14 and the signal from touch panel 9 IB show and notifies 
them to CPUlOl. CPUlOl directs activation of voice guidance to electronic speech circuit 1 lOA while 
directing the display of an actuation screen for the LCD controller 108 throu^ a data bus. Moreover, 
CPUlOl accesses VRAM 106 through an address bus and a data bus if needed, and writes in an 
indicative data. In addition, as an example of a touch panel, there is a touch panel (trade name: 
IntelliTouch) of the ultrasonic sensing method by touch panel systems incorporated company. 
[0023] Drawing in which drawing 5 shows the contents of the actuation guidance control table Tl, and 
drawing 6 are drawings showing the contents of the message table T2. The actuation guidance control 
table Tl is a file for managing the control data concerning actuation guidance according to a screen, and 
is stored in ROM103. The items of control data are the explanation message number corresponding to 
the coordinate and manual operation button which pinpoint the number of the manual operation buttons 
registered to the screen, and the location of a manual operation button and a definite message number, a 
transition place screen, a processing function, and an argimient. As for an explanation message number, 
an operator specifies the voice-told message lightly uttered by the manual operation button at the time of 
a touch, and a definite message number specifies the voice-told message uttered when an operator 
pushes a manual operation button strongly. 

[0024] The message table T2 is a file which matches a message number and voice data, and is stored in 
electronic speech circuit 1 lOA. If a message number is given from CPUlOl, electronic speech circuit 
1 lOA will generate a soxmd signal based on the voice data corresponding to it, and will drive 
loudspeaker HOB. 

[0025] In this operation gestalt, the common message CI for telling the purport whose actuated valve 
position is unsuitable forward with the individual message according to manual operation button (an 
explanation message and definite message), or telling operating procedure conmion to all manual 
operation buttons, and C2 - are prepared. Moreover, while telling the purport which the input decided 
as a definite message, layout explanation of the screen (transition place screen) newly displayed by the 
change of a screen is also given. For example, as drawing 3 explained, when the form carbon button 
K20 was pushed strongly and a display switched to the form selection screen Q2, the input of "form 
carbon button was decided. The 1st step, the 2nd step, and the 3rd step of paper-size carbon button is 
located in a Ime with right-hand side toward the bottom from the top. There is an auto form carbon 
button in the left-hand side upper part. The voice-told message " is uttered. Such explanation helps an 
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understanding for the function of the outline of a screen, and is useful for an especially unfamiliar 
operator or a visually handicapped operator. 

[0026] Hereafter, based on a flow chart, actuation of the actuation system 10 is explained in more detail. 
Drawing? is the Maine flow chart which shows actuation of the outline of CPUlOl of an actuation 
system. In addition, the program which CPUlOl performs is stored in ROM 103. 
[0027] ON of the main switch of a copying machine 1 initializes various kinds of control parameters 
first (#1). By this, the initial screen Ql explained by drawing 3 will be displayed on the liquid crystal 
touch panel 91. IThen, processing (#4) of others including control (#3) of the key input processing (#2) 
and voice guidance which receive the notice of the contents of actuation from CPU 102, and the 
communication link with other CPUs 102,501 is performed in order. And queuing of the intemal timer 
which specifies 1 routine time amount length is performed (#5), and it returns to step #2. While the 
power source is switched on, processing of step #2- step #5 is repeated. 

[0028] Drawing 8 is the flow chart of a key input processing subroutine. When the existence of actuation 
(touch) to the liquid crystal touch panel 91 is distinguished and (#20) touched, step #21 -#27 are 
processed. That is, first, the number n of ** is reset (#21) and it is confirmed wheflier the manual 
operation button is registered to the screen currently displayed at present with reference to the actuation 
guidance control table Tl (#22). When the manual operation button is registered, the number n of ** is 
incremented (#23) and it is confirmed whether the nimiber n of ** is over the number k of registered 
carbon buttons after that (#24). When the number n of ** is not over the number k of registered carbon 
buttons, a touch location confirms whether be within the limits of the manual operation button 
corresponding to the number n of ** (#25). If it is yes with this check, input process to the manual 
operation button with which it was touched by the operator will be performed (#26), and a return will be 
carried out to a main routine. Step # If it is a no in the check of 25, the same processing as the manual 
operation button which returned to step #23 and observed before paying attention to other manual 
operation buttons will be performed. Since it is the case where it is touched in the outside of the range of 
a manual operation button when the number n of ** exceeds the number k of registered carbon buttons, 
flie common message CI which tells that is set to a voice message queue (#27). By this, the voice "the 
carbon button does not exist" will be reproduced. A voice message queue is the data storage area of the 
FIFO format in a voice synthesizer 210 here. Moreover, the voice-told message itself is stored in 
electronic speech circuit 1 lOA. 

[0029] On tiie other hand, when there is no touch to the liquid crystal touch panel 91 , it progresses to 
step #28 and ON edge detection of a key switch is performed. If it is inmiediately after turning on a key 
switch (namely, on-edge), input process to the tumed-on key switch will be performed (#29). When 
there is neither a touch nor a key stroke, a return is carried out as it is. 

[0030] Drawing 9 is the flow chart of a form carbon button processing subroutine. This routine is 
performed in step #26 of drawing 8 as an input process to the carbon button with which it was touched, 
when touched in the form carbon button K20 of an initial screen Ql . 

[0031] First, reception propriety conditions are checked (#60). as the example of representation of the 
conditions to which actuation is forbidden — "copy — it is working — " — it is mentioned. When 
actuation may be received, the press level Pnew is compared with the threshold LI set up beforehand 
(#61). If it is Pnew<Ll, it will be regarded as what was touched lightly and will confirm whether to be 
the on-edge of a touch (#62). If it is an on-edge, the explanation message A 1 to the form carbon button 
K20 and the common message C2 which tells the procedxire of input decision will be set to a voice 
message queue (#63, #64). 

[0032] On the other hand, if it is Pnew>=Ll , it will regard as what [ what was touched strongly ], i.e., 
tfie thing which the input of the form carbon button K20 decided, screen transition processing which 
switches an initial screen Ql to the form selection screen Q2 will be performed (#65), and the definite 
message Bl to the form carbon button K20 will be set to a voice message queue (#66). 
[0033] Drawing 10 is the flow chart of A4Y carbon button processing subroutine. This routine is 
performed in step #26 of drawing 8 as an input process to the carbon button with which it was touched, 
when touched in the p^r-size carbon button K21 of A4Y in the form selection screen Q2. 
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[0034] Step #70-# The fundamental procedure of this routine which consists of 76 is the same as that of 
drawing 9 . In this routine, it is lightly touched in the paper-size carbon button K21 , and when it is an 
on-edge, the explanation message A2 to the paper-size carbon button K21 is set to a voice message 
queue (#71 -#73). moreover, when touched strongly, the paper-size carbon button K21 Regard it as what 
the input of the paper-size carbon button K21 decided, and screen transition processing which switches 
the form selection screen Q2 to an initial screen Ql is performed (#75). Definite message B-2 to the 
paper-size carbon button K21 is set to a voice message queue (#76), and it transmits to CPU501 by 
using as control data DIO the signal which shows that the form of A4Y was chosen (#77). In addition, 
CPU501 which received this control data DIG outputs the command of the purport which chooses tiie 
form chassis box which held the form of A4Y to CPU401 of the printer unit 30. 
[0035] Drawing 1 1 is the flow chart of a screen guidance key processing subroutine. This routine is 
performed in step #29 of drawing 8 as an input process to the tumed-on key switch, when the screen 
guidance key 97 on a control panel 90 is tumed on suitably. 

[0036] Reception propriety conditions are checked (#90), and if it is the case where actuation may be 
received, the explanation message registered to the screen currently displayed is set to the voice message 
queue in order (#91-#94). 

[0037] Drawing 12 is the flow chart of the voice guidance subroutine of drawing 7 . The status check of 
tiie voice mode key 98 is performed (#30), if voice mode is ON, all the message number data set to the 
voice message queue within 1 routine of the Maine flow will be directed sequentially from the oldest 
thing, and playback of delivery and a voice-told message will be directed to electronic speech circuit 
11 OA (#31 -#34). 

[0038] In the above operation gestalt, the actuation to a manual operation button is distinguished by the 
size of the thrust of a touch, and although the example which carries out voice playback of an 
explanation message or the definite message was given, actuation is also distinguishable by the count of 
a touch in a short time. That is, this invention is applicable not only to the pressure-sensitive type touch 
panel which detects a touch location and a touch pressure but the actuation system using the common 
touch panel which detects only a touch location. Next, an example of processing in the case of 
distinguishing actuation by the count of a touch is explained. 

[0039] Drawing 13 is the flow chart of the form carbon button processing concerning other operation 
gestalten. Reception propriety conditions are fu-st checked like the example of drawing 9 (#200). When 
actuation may be received, it checks that it is an on-edge (#201), and the status check of the touch flag 
which shows that there was a touch before is performed (#202). If the touch flag is off, this touch is a 
first-time touch. In this case, a touch flag is set to ON (#203). And the explanation message A 1 to the 
form carbon button K20 and the common message C2 which tells the procedure of input decision are set 
to a voice message queue (#204, #205). 

[0040] On the other hand, if a touch flag is ON, a touch flag will be retumed off (#206), screen 
transition processing which switches an initial screen Ql to the form selection screen Q2 will be 
performed (#207), and the definite message Bl to the form carbon button K20 will be set to a voice 
message queue (#208). 

[0041] In addition, a touch flag is reset also in the processing which returns a display called the input 
process in response to initialization processing of a power up, or ON of the panel reset key 94 to an 
initial screen. The touch flag in this operation gestalt is good also as what is reset automatically, when 
the 2nd touch is not detected, even if predetermined time (for example, 1 second) passes since a set. In 
this case, it can consider as the configuration which outputs a voice-told message by single tapping of a 
carbon button, and performs input decision control of the carbon button concerned by double tapping. 
[0042] 

[Effect of the Invention] According to invention of claim 1 thru/or claim 5, actuation of various devices 
becomes easier, and desired directions can be ensured, even if an operator is unfamiliar or it is visually 
handicapped. Moreover, actuation becomes possible also when abnormalities arise in a display. 
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